Identifying Electronic Medication Administration Record (eMAR) Usability Issues from Patient Safety Event Reports.

BACKGROUND: Improving our understanding of the association between medication errors and health information technology (health IT) usability has the potential to reduce errors and improve patient safety. This study used patient safety event reports (PSEs) to investigate the contribution of usability challenges associated with the electronic medication administration record (eMAR) to medication errors. METHODS: Free-text descriptions of 849 medication-related PSEs selected from 2.3 million reports were analyzed. Coders identified the specific health IT components, usability challenge categories, and nuanced usability themes that contributed to each PSE. Thematic analysis was conducted to refine categorizations and identify emerging themes. Final analysis was limited to PSEs involving a contribution from eMAR, either as the point of origin or as a downstream contributor to error. RESULTS: eMAR contributed to 473 PSEs. eMAR was the point of origin for 84 (17.8% of 473) PSEs. Usability challenge categories included Workflow support (n = 52, 11.0%) and Display/Visual clutter (n = 30, 6.3%). eMAR contributed downstream from the point of origin in 389 (82.2% of 473) PSEs, with errors stemming primarily from Pharmacy IT and computerized provider order entry (CPOE). Prominent secondary eMAR-associated usability challenges included Display/Visual clutter (n = 327, 69.1%) and Alerting (n = 32, 6.8%). CONCLUSION: This study identified several eMAR usability challenges, through the analysis of PSEs, that contribute to medication errors. Findings highlight the critical need for improving the eMAR user interface. Improved interface design, better vendor usability testing, eMAR-focused certification testing, consideration of work system factors, and eMAR-focused usability and safety testing by health care facilities can improve eMAR technology and patient safety.

Modeling patient-related workload in the emergency department using electronic health record data.

INTRODUCTION: Understanding and managing clinician workload is important for clinician (nurses, physicians and advanced practice providers) occupational health as well as patient safety. Efforts have been made to develop strategies for managing clinician workload by improving patient assignment. The goal of the current study is to use electronic health record (EHR) data to predict the amount of work that individual patients contribute to clinician workload (patient-related workload). METHODS: One month of EHR data was retrieved from an emergency department (ED). A list of workload indicators and five potential workload proxies were extracted from the data. Linear regression and four machine learning classification algorithms were utilized to model the relationship between the indicators and the proxies. RESULTS: Linear regression proved that the indicators explained a substantial amount of variance of the proxies (four out of five proxies were modeled with R2 > 0.80). Classification algorithms also showed success in classifying a patient as having high or low task demand based on data from early in the ED visit (e.g. 80 % accurate binary classification with data from the first hour). CONCLUSION: The main contribution of this study is demonstrating the potential of using EHR data to predict patient-related workload automatically in the ED. The predicted workload can potentially help in managing clinician workload by supporting decisions around the assignment of new patients to providers. Future work should focus on identifying the relationship between workload proxies and actual workload, as well as improving prediction performance of regression and multi-class classification.

Varying rates of patient identity verification when using computerized provider order entry.

OBJECTIVE: We sought to determine rates of computerized provider order entry (CPOE) patient identity verification and when and where in the ordering process verification occurred. MATERIALS AND METHODS: Fifty-five physicians from 4 healthcare systems completed simulated patient scenarios using their respective CPOE system (Epic or Cerner). Eye movements were recorded and analyzed. RESULTS: Across all participants patient id was verified significantly more often than not (62.4% vs 37.6%). Vendor A had significantly higher verification rates than not; vendor B had no difference. Participants using vendor A verified information significantly more often before signing the order than after (88.4% vs 11.6%); there was no difference in vendor B. The banner bar was the most frequent verification location. DISCUSSION: Factors such as CPOE design, physician training, and the use of a simulated methodology may be impacting verification rates. CONCLUSIONS: Verification rates vary by CPOE product, and this can have patient safety consequences.

Ten Best Practices for Improving Emergency Medicine Provider-Nurse Communication.

BACKGROUND: The current state of scientific knowledge regarding communication between emergency medicine (EM) providers indicates that communication is critical to safe and effective patient care. OBJECTIVES: In this study, we identified communication needs of EM nurses and physicians; in particular, what information should be conveyed, when, how, and to whom. METHODS: Five semi-structured focus groups and one interview were conducted with nine nurses, eight attending physicians, and four residents. Questions addressed how EM personnel use and share information about patients and clinical work, what information tends to be exchanged, and what additional information would be helpful to share. Sessions were audio recorded. Transcripts were generated and analyzed using a concept mapping approach (a visual qualitative analysis technique to represent and convey synthesized knowledge). RESULTS: Eleven concept maps were produced summarizing: information physicians needed from nurses and vice versa; methods of communication that could be utilized; barriers or obstacles to effective communication; strategies to enhance or ensure effective communication; and environmental or situational factors that impact communication. CONCLUSIONS: Our main finding of this research is that communication ensures shared awareness of patient health status, the care plan, status of plan steps and orders, and, especially, any critical changes or "surprises" regarding the health of a patient. Additionally, the research identified shared information needs; communication methods, strategies and barriers; and factors affecting successful communication, and has implications for both system and training design. Key implications for emergency nursing practice from this research are distilled in 10 'best practice' strategies for improving EM nurse-physician communication.

Design and Evaluation of an Integrated, Patient-Focused Electronic Health Record Display for Emergency Medicine.

BACKGROUND: Hospital emergency departments (EDs) are dynamic environments, involving coordination and shared decision making by staff who care for multiple patients simultaneously. While computerized information systems have been widely adopted in such clinical environments, serious issues have been raised related to their usability and effectiveness. In particular, there is a need to support clinicians to communicate and maintain awareness of a patient's health status, and progress through the ED plan of care. OBJECTIVE: This study used work-centered usability methods to evaluate an integrated patient-focused status display designed to support ED clinicians' communication and situation awareness regarding a patient's health status and progress through their ED plan of care. The display design was informed by previous studies we conducted examining the information and cognitive support requirements of ED providers and nurses. METHODS: ED nurse and provider participants were presented various scenarios requiring patient-prioritization and care-planning tasks to be performed using the prototype display. Participants rated the display in terms of its cognitive support, usability, and usefulness. Participants' performance on the various tasks, and their feedback on the display design and utility, was analyzed. RESULTS: Participants provided ratings for usability and usefulness for the display sections using a work-centered usability questionnaire-mean scores for nurses and providers were 7.56 and 6.6 (1 being lowest and 9 being highest), respectively. General usability scores, based on the System Usability Scale tool, were rated as acceptable or marginally acceptable. Similarly, participants also rated the display highly in terms of support for specific cognitive objectives. CONCLUSION: A novel patient-focused status display for emergency medicine was evaluated via a simulation-based study in terms of work-centered usability and usefulness. Participants' subjective ratings of usability, usefulness, and support for cognitive objectives were encouraging. These findings, including participants' qualitative feedback, provided insights for improving the design of the display.

A usability and safety analysis of electronic health records: a multi-center study.

To characterize the variability in usability and safety of EHRs from two vendors across four healthcare systems (2 Epic and 2 Cerner). Twelve to 15 emergency medicine physicians participated from each site and completed six clinical scenarios. Keystroke, mouse click, and video data were collected. From the six scenarios, two diagnostic imaging, laboratory, and medication tasks were analyzed. There was wide variability in task completion time, clicks, and error rates. For certain tasks, there were an average of a nine-fold difference in time and eight-fold difference in clicks. Error rates varied by task (X-ray 16.7% to 25%, MRI: 0 to 10%, Lactate: 0% to 14.3%, Tylenol: 0 to 30%; Taper: 16.7% to 50%). The variability in time, clicks, and error rates highlights the need for improved implementation optimization. EHR implementation, in addition to vendor design and development, is critical to usable and safe products.

Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques.

This article presents an evaluation of novel display concepts for an emergency department information system (EDIS) designed using cognitive systems engineering methods. EDISs assist emergency medicine staff with tracking patient care and ED resource allocation. Participants performed patient planning and orientation tasks using the EDIS displays and rated the display's ability to support various cognitive performance objectives along with the usability, usefulness, and predicted frequency of use for 18 system components. Mean ratings were positive for cognitive performance support objectives, usability, usefulness, and frequency of use, demonstrating the successful application of design methods to create useful and usable EDIS concepts that provide cognitive support for emergency medicine staff. Nurse and provider roles had significantly different perceptions of the usability and usefulness of certain EDIS components, suggesting that they have different information needs while working.

Cognitive engineering and health informatics: Applications and intersections.

Cognitive engineering is an applied field with roots in both cognitive science and engineering that has been used to support design of information displays, decision support, human-automation interaction, and training in numerous high risk domains ranging from nuclear power plant control to transportation and defense systems. Cognitive engineering provides a set of structured, analytic methods for data collection and analysis that intersect with and complement methods of Cognitive Informatics. These methods support discovery of aspects of the work that make performance challenging, as well as the knowledge, skills, and strategies that experts use to meet those challenges. Importantly, cognitive engineering methods provide novel representations that highlight the inherent complexities of the work domain and traceable links between the results of cognitive analyses and actionable design requirements. This article provides an overview of relevant cognitive engineering methods, and illustrates how they have been applied to the design of health information technology (HIT) systems. Additionally, although cognitive engineering methods have been applied in the design of user-centered informatics systems, methods drawn from informatics are not typically incorporated into a cognitive engineering analysis. This article presents a discussion regarding ways in which data-rich methods can inform cognitive engineering.

Communication in the Electronic Age: an Analysis of Face-to-Face Physician-Nurse Communication in the Emergency Department.

We describe the patterns and content of nurse to physician verbal conversations in three emergency departments (EDs) with electronic health records. Emergency medicine physicians and nurses were observed for 2 h periods. Researchers used paper notes to document the characteristics (e.g., partners involved, location of communication, who initiated communication) and content of nurse to physician conversations. Eighteen emergency nurses and physicians (nine each) were observed for a total of 36 h. Two hundred and fifty-five unique communication events were recorded across three emergency departments spread evenly across day, evening, and night shifts. A qualitative analysis of communication event content revealed 5 types of communication and 13 content themes. Content themes covered a broad range of topics including exchange of patient health information, management of the ED, and coordination of orders. Physician participants experienced significantly more communication events than nurse participants, while nurses initiated significantly more communication events than physicians. Most of the communication events occurred at the physician workstation followed by patient treatment areas. This study describes nature of verbal nurse to physician communication in the ED. Direct communication is still used to communicate important information, such as information about patients' status, in EDs with established electronic health records. Our results provide an overview of information exchanged in the ED which can serve as a basis for designing improved information support systems.

Barriers to comparing the usability of electronic health records.

Despite the widespread adoption of electronic health records (EHRs), usability of many EHRs continues to be suboptimal, with some vendors failing to meet usability standards, resulting in clinician frustration and patient safety hazards. In an effort to increase EHR vendor competition on usability, recommendations have been made and legislation drafted to develop comparison tools that would allow purchasers to better understand the usability of EHR products prior to purchase. Usability comparison can be based on EHR vendor design and development processes, vendor usability testing as part of the Office of the National Coordinator for Health Information Technology certification program, and usability of implemented products. Barriers exist within the current certified health technology program that prevent effective comparison of usability during each of these stages. We describe the importance of providing purchasers with improved information about EHR usability, barriers to making usability comparisons, and solutions to overcome these barriers.

Usability in Health IT: Beyond Compliance to Meaningful Design and Assessment.

The relatively rapid transition from a paper-based system to a digital system in healthcare has not always employed a sophisticated integration of usability concepts. Yet usability is critical to safety and to effectiveness of the electronic health record, and regulators and policy makers have been increasingly focused on this area. This panel will provide a variety of perspectives on this important issue, ranging from a description of the problem based on current vendor usability practices; recommendations regarding domain content rich usability processes including use cases, assessments, and scenarios; and the extension of usability assessments and design improvements to post-system implementation.

Emergency Physician Task Switching Increases With the Introduction of a Commercial Electronic Health Record.

STUDY OBJECTIVE: We evaluate how the transition from a homegrown electronic health record to a commercial one affects emergency physician work activities from initial introduction to long-term use. METHODS: We completed a quasi-experimental study across 3 periods during the transition from a homegrown system to a commercially available electronic health record with computerized provider order entry. Observation periods consisted of pre-implementation, 1 month before the implementation of the commercial electronic health record; "go-live" 1 week after implementation; and post-implementation, 3 to 4 months after use began. Fourteen physicians were observed in each period (N=42) with a minute-by-minute observation template to record emergency physician time allocation across 5 task-based categories (computer, verbal communication, patient room, paper [chart/laboratory results], and other). The average number of tasks physicians engaged in per minute was also analyzed as an indicator of task switching. RESULTS: From pre- to post-implementation, there were no significant differences in the amount of time spent on the various task categories. There were changes in time allocation from pre-implementation to go-live and go-live to pre-implementation, characterized by a significant increase in time spent on computer tasks during go-live relative to the other periods. Critically, the number of tasks physicians engaged in per minute increased from 1.7 during pre-implementation to 1.9 during post-implementation (difference 0.19 tasks per minute; 95% confidence interval 0.039 to 0.35). CONCLUSION: The increase in the number of tasks physicians engaged in per minute post-implementation indicates that physicians switched tasks more frequently. Frequent task switching behavior raises patient safety concerns.

Exploring methods for identifying related patient safety events using structured and unstructured data.

Most healthcare systems have implemented patient safety event reporting systems to identify safety hazards. Searching the safety event data to find related patient safety reports and identify trends is challenging given the complexity and quantity of these reports. Structured data elements selected by the event reporter may be inaccurate and the free-text narrative descriptions are difficult to analyze. In this paper we present and explore methods for utilizing both the unstructured free-text and structured data elements in safety event reports to identify and rank similar events. We evaluate the results of three different free-text search methods, including a unique topic modeling adaptation, and structured element weights, using a patient fall use case. The various search techniques and weight combinations tended to prioritize different aspects of the event reports leading to different search and ranking results. These search and prioritization methods have the potential to greatly improve patient safety officers, and other healthcare workers, understanding of which safety event reports are related.

Electronic health record usability: analysis of the user-centered design processes of eleven electronic health record vendors.

The usability of electronic health records (EHRs) continues to be a point of dissatisfaction for providers, despite certification requirements from the Office of the National Coordinator that require EHR vendors to employ a user-centered design (UCD) process. To better understand factors that contribute to poor usability, a research team visited 11 different EHR vendors in order to analyze their UCD processes and discover the specific challenges that vendors faced as they sought to integrate UCD with their EHR development. Our analysis demonstrates a diverse range of vendors' UCD practices that fall into 3 categories: well-developed UCD, basic UCD, and misconceptions of UCD. Specific challenges to practicing UCD include conducting contextually rich studies of clinical workflow, recruiting participants for usability studies, and having support from leadership within the vendor organization. The results of the study provide novel insights for how to improve usability practices of EHR vendors.

Assessment of Innovative Emergency Department Information Displays in a Clinical Simulation Center.

The objective of this work was to assess the functional utility of new display concepts for an emergency department information system created using cognitive systems engineering methods, by comparing them to similar displays currently in use. The display concepts were compared to standard displays in a clinical simulation study during which nurse-physician teams performed simulated emergency department tasks. Questionnaires were used to assess the cognitive support provided by the displays, participants' level of situation awareness, and participants' workload during the simulated tasks. Participants rated the new displays significantly higher than the control displays in terms of cognitive support. There was no significant difference in workload scores between the display conditions. There was no main effect of display type on situation awareness, but there was a significant interaction; participants using the new displays showed improved situation awareness from the middle to the end of the session. This study demonstrates that cognitive systems engineering methods can be used to create innovative displays that better support emergency medicine tasks, without increasing workload, compared to more standard displays. These methods provide a means to develop emergency department information systems-and more broadly, health information technology-that better support the cognitive needs of healthcare providers.